BENCHMARKING AND IMPLEMENTATION OF A NEW INDEPENDENT MONTE CARLO DOSE CALCULATION QUALITY ASSURANCE AUDIT TOOL FOR CLINICAL TRIALS

Introduction Commercial treatment planning systems employ a variety of dose calculation algorithms to plan and predict the dose distributions a patient receives during external beam radiation therapy. Traditionally, the Radiological Physics Center has relied on measurements to assure that institutions participating in the National Cancer Institute sponsored clinical trials administer radiation in doses that are clinically comparable to those of other participating institutions. To complement the effort of the RPC, an independent dose calculation tool needs to be developed that will enable a generic method to determine patient dose distributions in three dimensions and to perform retrospective analysis of radiation delivered to patients who enrolled in past clinical trials. Methods A multi-source model representing output for Varian 6 MV and 10 MV photon beams was developed and evaluated. The Monte Carlo algorithm, know as the Dose Planning Method (DPM), was used to perform the dose calculations. The dose calculations were compared to measurements made in a water phantom and in anthropomorphic phantoms. Intensity modulated radiation therapy and stereotactic body radiation therapy techniques were used with the anthropomorphic phantoms. Finally, past patient treatment plans were selected and recalculated using DPM and contrasted against a commercial dose calculation algorithm. Results The multi-source model was validated for the Varian 6 MV and 10 MV photon beams. The benchmark evaluations demonstrated the ability of the model to accurately calculate dose for the Varian 6 MV and the Varian 10 MV source models. The patient calculations proved that the model was reproducible in determining dose under similar conditions described by the benchmark tests. Conclusions The dose calculation tool that relied on a multi-source model approach and used the DPM code to calculate dose was developed, validated, and benchmarked for the Varian 6 MV and 10 MV photon beams. Several patient dose distributions were contrasted against a commercial algorithm to provide a proof of principal to use as an application in monitoring clinical trial activity.

Development and Implementation of the Use of Optically Stimulated Luminescent Detectors in the Radiological Physics Center Anthropomorphic Quality Assurance Phantoms

The Radiological Physics Center (RPC) uses both on-site and remote reviews to credential institutions for participation in clinical trials. Anthropomorphic quality assurance (QA) phantoms are one tool the RPC uses to remotely audit institutions, which include thermoluminescent dosimeters (TLDs) and radiochromic film. The RPC desires to switch from TLD as the absolute dosimeter in the phantoms, to optically stimulated luminescent dosimeters (OSLDs), but a problem lies in the angular dependence exhibited by the OSLD. The purpose of this study was to characterize the angular dependence of OSLD and establish a correction factor if necessary, to provide accurate dosimetric measurements as a replacement for TLD in the QA phantoms. A 10 cm diameter high-impact polystyrene spherical phantom was designed and constructed to hold an OSLD to study the angular response of the dosimeter under the simplest of circumstances for both coplanar and non-coplanar treatment deliveries. OSLD were irradiated in the spherical phantom, and the responses of the dosimeter from edge-on angles were normalized to the response when irradiated with the beam incident normally on the surface of the dosimeter. The average normalized response was used to establish an angular correction factor for 6 MV and 18 coplanar treatments, and for 6 MV non-coplanar treatments specific to CyberKnife. The RPC pelvic phantom dosimetry insert was modified to hold OSLD, in addition to the TLD, adjacent to the planes of film. Treatment plans of increasing angular beam delivery were developed, three in Pinnacle v9.0 (4-field box, IMRT, and VMAT) and one in Accuray’s MultiPlan v3.5.3 (CyberKnife). The plans were delivered to the pelvic phantom containing both TLD and OSLD in the target volume. The pelvic phantom was also sent to two institutions to be irradiated as trials, one delivering IMRT, and the other a CyberKnife treatment. For the IMRT deliveries and the two institution trials, the phantom also included film in the sagittal and coronal planes. The doses measured from the TLD and OSLD were calculated for each irradiation, and the angular correction factors established from the spherical phantom irradiations were applied to the OSLD dose. The ratio of the TLD dose to the angular corrected OSLD dose was calculated for each irradiation. The corrected OSLD dose was found to be within 1% of the TLD measured dose for all irradiations, with the exception of the in-house CyberKnife deliveries. The films were normalized to both TLD measured dose and the corrected OSLD dose. Dose profiles were obtained and gamma analysis was performed using a 7%/4 mm criteria, to compare the ability of the OSLD, when corrected for the angular dependence, to provide equivalent results to TLD. The results of this study indicate that the OSLD can effectively be used as a replacement for TLD in the RPC’s anthropomorphic QA phantoms for coplanar treatment deliveries when a correction is applied for the dosimeter’s angular dependence.

Quality assurance plan for a vaccine preventable diseases surveillance program

Public health surveillance programs for vaccine preventable diseases (VPD) need functional quality assurance (QA) in order to operate with high quality activities to prevent preventable communicable diseases from spreading in the community. Having a functional QA plan can assure the performance and quality of a program without putting excessive stress on the resources. A functional QA plan acts as a check on the quality of day-to-day activities performed by the VPD surveillance program while also providing data that would be useful for evaluating the program. This study developed a QA plan that involves collection, collation, analysis and reporting of information based on standardized (predetermined) formats and indicators as an integral part of routine work for the vaccine preventable disease surveillance program at the City of Houston Department of Health and Human Services. The QA plan also provides sampling and analysis plans for assessing various QA indicators, as well as recommendations to the Houston Department of Health and Humans Services for implementation of the QA plan. The QA plan developed for VPD surveillance in the City of Houston is intended to be a low cost system that could serve as a template for QA plans as part of other public health programs not only in the city or the nation, but could be adapted for use anywhere across the globe. Having a QA plan for VPD surveillance in the City of Houston would serve well for the funding agencies like the CDC by assuring that the resources are being expended efficiently, while achieving the real goal of positively impacting the health and lives of the recipient/target population. ^

Development and implementation of a dynamic heterogeneous proton equivalent anthropomorphic thorax phantom for the assessment of scanned proton beam therapy

DEVELOPMENT AND IMPLEMENTATION OF A DYNAMIC HETEROGENEOUS PROTON EQUIVALENT ANTHROPOMORPHIC THORAX PHANTOM FOR THE ASSESSMENT OF SCANNED PROTON BEAM THERAPY by James Leroy Neihart, B.S. APPROVED: ______________________________David Followill, Ph.D. ______________________________Peter Balter, Ph.D. ______________________________Narayan Sahoo, Ph.D. ______________________________Kenneth Hess, Ph.D. ______________________________Paige Summers, M.S. APPROVED: ____________________________ Dean, The University of Texas Graduate School of Biomedical Sciences at Houston DEVELOPMENT AND IMPLEMENTATION OF A DYNAMIC HETEROGENEOUS PROTON EQUIVALENT ANTHROPOMORPHIC THORAX PHANTOM FOR THE ASSESSMENT OF SCANNED PROTON BEAM THERAPY A THESIS Presented to the Faculty of The University of Texas Health Science Center at Houston andThe University of TexasMD Anderson Cancer CenterGraduate School of Biomedical Sciences in Partial Fulfillment of the Requirements for the Degree of MASTER OF SCIENCE by James Leroy Neihart, B.S. Houston, Texas Date of Graduation August, 2013 Acknowledgments I would like to acknowledge my advisory committee members, chair David Followill, Ph.D., Peter Balter, Ph.D, Narayan Sahoo, Ph.D., Kenneth Hess, Ph.D., Paige Summers M.S. and, for their time and effort contributed to this project. I would additionally like to thank the faculty and staff at the PTC-H and the RPC who assisted in many aspects of this project. Falk Pӧnisch, Ph.D. for his breath hold proton therapy treatment expertise, Matt Palmer and Jaques Bluett for proton dosimetry assistance, Matt Kerr for verification plan assistance, Carrie Amador, Nadia Hernandez, Trang Nguyen, Andrea Molineu, Lynda McDonald for TLD and film dosimetry assistance. Finally, I would like to thank my wife and family for their support and encouragement during my research and studies. Development and implementation of a dynamic heterogeneous proton equivalent anthropomorphic thorax phantom for the assessment of scanned proton beam therapy By: James Leroy Neihart, B.S. Chair of Advisory Committee: David Followill, Ph.D Proton therapy has been gaining ground recently in radiation oncology. To date, the most successful utilization of proton therapy is in head and neck cases as well as prostate cases. These tumor locations do not suffer from the resulting difficulties of treatment delivery as a result of respiratory motion. Lung tumors require either breath hold or motion tracking, neither of which have been assessed with an end-to-end phantom for proton treatments. Currently, the RPC does not have a dynamic thoracic phantom for proton therapy procedure assessment. Additionally, such a phantom could be an excellent means of assessing quality assurance of the procedures of proton therapy centers wishing to participate in clinical trials. An eventual goal of this phantom is to have a means of evaluating and auditing institutions for the ability to start clinical trials utilizing proton therapy procedures for lung cancers. Therefore, the hypothesis of this study is that a dynamic anthropomorphic thoracic phantom can be created to evaluate end-to-end proton therapy treatment procedures for lung cancer to assure agreement between the measured and calculated dose within 5% / 5 mm with a reproducibility of 2%. Multiple materials were assessed for thoracic heterogeneity equivalency. The phantom was designed from the materials found to be in greatest agreement. The phantom was treated in an end-to-end treatment four times, which included simulation, treatment planning and treatment delivery. Each treatment plan was delivered three times to assess reproducibility. The dose measured within the phantom was compared to that of the treatment plan. The hypothesis was fully supported for three of the treatment plans, but failed the reproducibility requirement for the most aggressive treatment plan.

A comparative analysis of hospital -based physician monitoring systems

The purpose of the multiple case-study was to determine how hospital subsystems (such as physician monitoring and credentialing; quality assurance; risk management; and peer review) were supporting the monitoring of physicians? Three large metropolitan hospitals in Texas were studied and designated as hospitals #1, #2, and #3. Realizing that hospital subsystems are a unique entity and part of a larger system, conclusions were made on the premises of a quality control system, in relation to the tools of government (particularly the Health Care Quality Improvement Act (HCQIA)), and in relation to itself as a tool of a hospital.^ Three major analytical assessments were performed. First, the subsystems were analyzed as to their "completeness"; secondly, the subsystems were analyzed for "performance"; and thirdly, the subsystems were analyzed in reference to the interaction of completeness and performance.^ The physician credentialing and monitoring and the peer review subsystems as quality control systems were most complete, efficient, and effective in hospitals #1 and #3. The HCQIA did not seem to be an influencing factor in the completeness of the subsystem in hospital #1. The quality assurance and risk management subsystem in hospital #2 was not representative of completeness and performance and the HCQIA was not an influencing factor in the completeness of the Q.A. or R.M. systems in any hospital. The efficiency (computerization) of the physician credentialing, quality assurance and peer review subsystems in hospitals #1 and #3 seemed to contribute to their effectiveness (system-wide effect).^ The results indicated that the more complete, effective, and efficient subsystems were characterized by (1) all defined activities being met, (2) the HCQIA being an influencing factor, (3) a decentralized administrative structure, (4) computerization an important element, and (5) staff was sophisticated in subsystem operations. However, other variables were identified which deserve further research as to their effect on completeness and performance of subsystems. They include (1) medical staff affiliations, (2) system funding levels, (3) the system's administrative structure, and (4) the physician staff "cultural" characteristics. Perhaps by understanding other influencing factors, health care administrators may plan subsystems that will be compatible with legislative requirements and administrative objectives. ^

Perinatal mortality and quality of care at the National Institute of Perinatology: A 3-year analysis

Quality of medical care has been indirectly assessed through the collection of negative outcomes. A preventable death is one that could have been avoided if optimum care had been offered. The general objective of the present project was to analyze the perinatal mortality at the National Institute of Perinatology (located in Mexico City) by social, biological and some available components of quality of care such as avoidability, provider responsibility, and structure and process deficiencies in the delivery of medical care. A Perinatal Mortality Committee data base was utilized. The study population consisted of all singleton perinatal deaths occurring between January 1, 1988 and June 30, 1991 (n = 522). A proportionate study was designed.^ The population studied mostly corresponded to married young adult mothers, who were residents of urban areas, with an educational level of junior high school or more, two to three pregnancies, and intermediate prenatal care. The mean gestational age at birth was 33.4 $\pm$ 3.9 completed weeks and the mean birthweight at birth was 1,791.9 $\pm$ 853.1 grams.^ Thirty-five percent of perinatal deaths were categorized as avoidable. Postnatal infection and premature rupture of membranes were the most frequent primary causes of avoidable perinatal death. The avoidable perinatal mortality rate was 8.7 per 1000 and significantly declined during the study period (p $<$.05). Preventable perinatal mortality aggregated data suggested that at least part of the mortality decline for amenable conditions was due to better medical care.^ Structure deficiencies were present in 35% of avoidable deaths and process deficiencies were present in 79%. Structure deficiencies remained constant over time. Process deficiencies consisted of diagnosis failures (45.8%) and treatment failures (87.3%), they also remained constant through the years. Party responsibility was as follows: Obstetric (35.4%), pediatric (41.4%), institutional (26.5%), and patient (6.6%). Obstetric responsibility significantly increased during the study period (p $<$.05). Pediatric responsibility declined only for newborns less than 1500 g (p $<$.05). Institutional responsibility remained constant.^ Process deficiencies increased the risk for an avoidable death eightfold (confidence interval 1.7-41.4, p $<$.01) and provider responsibility ninety-fivefold (confidence interval 14.8-612.1, p $<$.001), after adjustment for several confounding variables. Perinatal mortality due to prematurity, barotrauma and nosocomial infection, was highly preventable, but not that due to transpartum asphyxia. Once specific deficiencies in the quality of care have been identified, quality assurance actions should begin. ^

Data quality in trauma transfusion studies and the impact of missing data on predicting massive transfusion

Maximizing data quality may be especially difficult in trauma-related clinical research. Strategies are needed to improve data quality and assess the impact of data quality on clinical predictive models. This study had two objectives. The first was to compare missing data between two multi-center trauma transfusion studies: a retrospective study (RS) using medical chart data with minimal data quality review and the PRospective Observational Multi-center Major Trauma Transfusion (PROMMTT) study with standardized quality assurance. The second objective was to assess the impact of missing data on clinical prediction algorithms by evaluating blood transfusion prediction models using PROMMTT data. RS (2005-06) and PROMMTT (2009-10) investigated trauma patients receiving ≥ 1 unit of red blood cells (RBC) from ten Level I trauma centers. Missing data were compared for 33 variables collected in both studies using mixed effects logistic regression (including random intercepts for study site). Massive transfusion (MT) patients received ≥ 10 RBC units within 24h of admission. Correct classification percentages for three MT prediction models were evaluated using complete case analysis and multiple imputation based on the multivariate normal distribution. A sensitivity analysis for missing data was conducted to estimate the upper and lower bounds of correct classification using assumptions about missing data under best and worst case scenarios. Most variables (17/33=52%) had <1% missing data in RS and PROMMTT. Of the remaining variables, 50% demonstrated less missingness in PROMMTT, 25% had less missingness in RS, and 25% were similar between studies. Missing percentages for MT prediction variables in PROMMTT ranged from 2.2% (heart rate) to 45% (respiratory rate). For variables missing >1%, study site was associated with missingness (all p≤0.021). Survival time predicted missingness for 50% of RS and 60% of PROMMTT variables. MT models complete case proportions ranged from 41% to 88%. Complete case analysis and multiple imputation demonstrated similar correct classification results. Sensitivity analysis upper-lower bound ranges for the three MT models were 59-63%, 36-46%, and 46-58%. Prospective collection of ten-fold more variables with data quality assurance reduced overall missing data. Study site and patient survival were associated with missingness, suggesting that data were not missing completely at random, and complete case analysis may lead to biased results. Evaluating clinical prediction model accuracy may be misleading in the presence of missing data, especially with many predictor variables. The proposed sensitivity analysis estimating correct classification under upper (best case scenario)/lower (worst case scenario) bounds may be more informative than multiple imputation, which provided results similar to complete case analysis.^

Commissioning an Anthropomorphic Spine and Lung Phantom for Remote Dose Verification of Institutions Participating in RTOG 0631

The RPC developed a new phantom to ensure comparable and consistent radiation administration in spinal radiosurgery clinical trials. This study assessed the phantom’s dosimetric and anatomic utility. The ‘spine phantom’ is a water filled thorax with anatomy encountered in spinal radiosurgery: target volume, vertebral column, spinal canal, esophagus, heart, and lungs. The dose to the target volume was measured with axial and sagittal planes of radiochromic film and thermoluminescent dosimeters (TLD). The dose distributions were measured with the radiochromic film calibrated to the absolute dose measured by the TLD. Four irradiations were administered: a four angle box plan, a seven angle conformal plan, a seven angle IMRT plan, and a nine angle IMRT plan (denoted as IMRT plan #1 and plan #2, respectively). In each plan, at least 95% of the defined tumor volume received 8 Gy. For each irradiation the planned and administered dose distributions were registered via pinpricks, and compared using point dose measurements, dose profiles, isodose distributions, and gamma analyses. Based on previous experience at the RPC, a gamma analysis was considering passing if greater than 95% of pixels passed the criteria of 5% dose difference and 3 mm distance-to-agreement. Each irradiation showed acceptable agreement in the qualitative assessments and exceeded the 95% passing rate at the 5% / 3 mm criteria, except IMRT plan #1, which was determined to have been poorly localized during treatment administration. The measured and planned dose distributions demonstrated acceptable agreement at the 5% / 3 mm criteria, and the spine phantom was determined to be a useful tool for the remote assessment of an institution’s treatment planning and dose delivery regimen.

MODIFICATION AND IMPLEMENTATION OF THE RPC HETEROGENEOUS THORAX PHANTOM FOR VERIFICATION OF PROTON THERAPY TREATMENT PROCEDURES

The Radiological Physics Center (RPC) provides heterogeneous phantoms that are used to evaluate radiation treatment procedures as part of a comprehensive quality assurance program for institutions participating in clinical trials. It was hypothesized that the existing RPC heterogeneous thorax phantom can be modified to assess lung tumor proton beam therapy procedures involving patient simulation, treatment planning, and treatment delivery, and could confirm agreement between the measured dose and calculated dose within 5%/3mm with a reproducibility of 5%. The Hounsfield Units (HU) for lung equivalent materials (balsa wood and cork) was measured using a CT scanner. The relative linear stopping power (RLSP) of these materials was measured. The linear energy transfer (LET) of Gafchromic EBT2 film was analyzed utilizing parallel and perpendicular orientations in a water tank and compared to ion chamber readings. Both parallel and perpendicular orientations displayed a quenching effect underperforming the ion chamber, with the parallel orientation showing an average 31 % difference and the perpendicular showing an average of 15% difference. Two treatment plans were created that delivered the prescribed dose to the target volume, while achieving low entrance doses. Both treatment plans were designed using smeared compensators and expanded apertures, as would be utilized for a patient in the clinic. Plan 1a contained two beams that were set to orthogonal angles and a zero degree couch kick. Plan 1b utilized two beams set to 10 and 80 degrees with a 15 degree couch kick. EBT2 film and TLD were inserted and the phantom was irradiated 3 times for each plan. Both plans passed the criteria for the TLD measurements where the TLD values were within 7% of the dose calculated by Eclipse. Utilizing the 5%/3mm criteria, the 3 trial average of overall pass rate was 71% for Plan 1a. The 3 trial average for the overall pass rate was 76% for Plan 1b. The trials were then analyzed using RPC conventional lung treatment guidelines set forth by the RTOG: 5%/5mm, and an overall pass rate of 85%. Utilizing these criteria, only Plan 1b passed for all 3 trials, with an average overall pass rate of 89%.

EVALUATION OF INTENSITY MODULATED RADIATION THERAPY (IMRT) DELIVERY ERROR DUE TO IMRT TREATMENT PLAN COMPLEXITY AND IMPROPERLY MATCHED DOSIMETRY DATA

Intensity modulated radiation therapy (IMRT) is a technique that delivers a highly conformal dose distribution to a target volume while attempting to maximally spare the surrounding normal tissues. IMRT is a common treatment modality used for treating head and neck (H&N) cancers, and the presence of many critical structures in this region requires accurate treatment delivery. The Radiological Physics Center (RPC) acts as both a remote and on-site quality assurance agency that credentials institutions participating in clinical trials. To date, about 30% of all IMRT participants have failed the RPC’s remote audit using the IMRT H&N phantom. The purpose of this project is to evaluate possible causes of H&N IMRT delivery errors observed by the RPC, specifically IMRT treatment plan complexity and the use of improper dosimetry data from machines that were thought to be matched but in reality were not. Eight H&N IMRT plans with a range of complexity defined by total MU (1460-3466), number of segments (54-225), and modulation complexity scores (MCS) (0.181-0.609) were created in Pinnacle v.8m. These plans were delivered to the RPC’s H&N phantom on a single Varian Clinac. One of the IMRT plans (1851 MU, 88 segments, and MCS=0.469) was equivalent to the median H&N plan from 130 previous RPC H&N phantom irradiations. This average IMRT plan was also delivered on four matched Varian Clinac machines and the dose distribution calculated using a different 6MV beam model. Radiochromic film and TLD within the phantom were used to analyze the dose profiles and absolute doses, respectively. The measured and calculated were compared to evaluate the dosimetric accuracy. All deliveries met the RPC acceptance criteria of ±7% absolute dose difference and 4 mm distance-to-agreement (DTA). Additionally, gamma index analysis was performed for all deliveries using a ±7%/4mm and ±5%/3mm criteria. Increasing the treatment plan complexity by varying the MU, number of segments, or varying the MCS resulted in no clear trend toward an increase in dosimetric error determined by the absolute dose difference, DTA, or gamma index. Varying the delivery machines as well as the beam model (use of a Clinac 6EX 6MV beam model vs. Clinac 21EX 6MV model), also did not show any clear trend towards an increased dosimetric error using the same criteria indicated above.

The design and evaluation of a 2D dose verification system for intensity modulated radiotherapy

The usage of intensity modulated radiotherapy (IMRT) treatments necessitates a significant amount of patient-specific quality assurance (QA). This research has investigated the precision and accuracy of Kodak EDR2 film measurements for IMRT verifications, the use of comparisons between 2D dose calculations and measurements to improve treatment plan beam models, and the dosimetric impact of delivery errors. New measurement techniques and software were developed and used clinically at M. D. Anderson Cancer Center. The software implemented two new dose comparison parameters, the 2D normalized agreement test (NAT) and the scalar NAT index. A single-film calibration technique using multileaf collimator (MLC) delivery was developed. EDR2 film's optical density response was found to be sensitive to several factors: radiation time, length of time between exposure and processing, and phantom material. Precision of EDR2 film measurements was found to be better than 1%. For IMRT verification, EDR2 film measurements agreed with ion chamber results to 2%/2mm accuracy for single-beam fluence map verifications and to 5%/2mm for transverse plane measurements of complete plan dose distributions. The same system was used to quantitatively optimize the radiation field offset and MLC transmission beam modeling parameters for Varian MLCs. While scalar dose comparison metrics can work well for optimization purposes, the influence of external parameters on the dose discrepancies must be minimized. The ability of 2D verifications to detect delivery errors was tested with simulated data. The dosimetric characteristics of delivery errors were compared to patient-specific clinical IMRT verifications. For the clinical verifications, the NAT index and percent of pixels failing the gamma index were exponentially distributed and dependent upon the measurement phantom but not the treatment site. Delivery errors affecting all beams in the treatment plan were flagged by the NAT index, although delivery errors impacting only one beam could not be differentiated from routine clinical verification discrepancies. Clinical use of this system will flag outliers, allow physicists to examine their causes, and perhaps improve the level of agreement between radiation dose distribution measurements and calculations. The principles used to design and evaluate this system are extensible to future multidimensional dose measurements and comparisons. ^

Measuring the quality of life of patients with diabetes: Validating the tool and determining the effects on quality of life

There are several tools for measuring quality of life (QoL) and specifically, health-related quality of life (HRQoL) for persons with diabetes. A commonly-used measure, the Diabetes Quality of Life (DQOL) Survey, developed for the Diabetes Control and Complications Trial (DCCT), has been used in several experimental settings, and its reliability and validity are well-established. However, it is considered too long to be of practical use in clinical settings. Because of this, a shortened version of the tool was used recently in the Community Diabetes Education (CoDE) Project in Dallas, Texas, a clinic-based patient education program that uses a specially-trained community healthcare worker to provide patient education. However, the modified scale has never been tested for reliability and validity. Thus, one goal of this thesis was to measure these psychometric properties of the scale. After establishing the reliability and validity, the results of the scale were analyzed to determine the effects of the intervention on the subjects’ quality of life. The changes in QoL scales were compared with changes in physiologic measures which are most closely allied with diabetes, including blood glucose levels, weight/BMI, co-morbidities and health beliefs in order to determine if there is a relationship between such measures and quality of life. The results of the reliability and validity testing were not conclusive. Measures of reliability and criterion validity were established, but these contrasted with poor measures of repeatability and content validity. The effect of the intervention on quality of life, however, was more significant, particularly regarding the impact of diabetes. Those who received the counseling had significantly higher scores on the Impact scale than those who did not, and the former group had much greater improvement in scores over the twelve month period than the latter group. ^

Quality in healthcare organizations: Its meaning and measurement

This dissertation explores two important aspects of quality in healthcare: its meaning and its measurement. For a better understanding of what quality means, the history of quality in the manufacturing and service industries is reviewed. Concepts that are similar are pointed out as are concepts that are different. The definition introduced by the Institute of Medicine (IOM) for quality in healthcare and the six IOM aims of safety, timeliness, patient-centeredness, effectiveness, efficiency, and equitableness for a high quality healthcare system are adopted. The current activities by various organizations that proclaim improvement in quality or measurement of quality as their goal are reviewed. This is followed by examining what is offered by these organizations in terms of how many of IOM aims they address.^ This dissertation ends by offering a quality measurement framework that satisfies all IOM aims. Operational aspects of the measurement framework are discussed. Future areas of research are also discussed.^

CHARACTERIZATION OF THE COUNT RATE PERFORMANCE AND EVALUATION OF THE EFFECTS OF HIGH COUNT RATES ON MODERN GAMMA CAMERAS

CHARACTERIZATION OF THE COUNT RATE PERFORMANCE AND EVALUATION OF THE EFFECTS OF HIGH COUNT RATES ON MODERN GAMMA CAMERAS Michael Stephen Silosky, B.S. Supervisory Professor: S. Cheenu Kappadath, Ph.D. Evaluation of count rate performance (CRP) is an integral component of gamma camera quality assurance and measurement of system dead time (τ) is important for quantitative SPECT. The CRP of three modern gamma cameras was characterized using established methods (Decay and Dual Source) under a variety of experimental conditions. For the Decay method, input count rate was plotted against observed count rate and fit to the paralyzable detector model (PDM) to estimate τ (Rates method). A novel expression for observed counts as a function of measurement time interval was derived and the observed counts were fit to this expression to estimate τ (Counts method). Correlation and Bland-Altman analysis were performed to assess agreement in estimates of τ between methods. The dependencies of τ on energy window definition and incident energy spectrum were characterized. The Dual Source method was also used to estimate τ and its agreement with the Decay method under identical conditions and the effects of total activity and the ratio of source activities were investigated. Additionally, the effects of count rate on several performance metrics were evaluated. The CRP curves for each system agreed with the PDM at low count rates but deviated substantially at high count rates. Estimates of τ for the paralyzable portion of the CRP curves using the Rates and Counts methods were highly correlated (r=0.999) but with a small (~6%) difference. No significant difference was observed between the highly correlated estimates of τ using the Decay or Dual Source methods under identical experimental conditions (r=0.996). Estimates of τ increased as a power-law function with decreasing ratio of counts in the photopeak to the total counts and linearly with decreasing spectral effective energy. Dual Source method estimates of τ varied as a quadratic with the ratio of the single source to combined source activities and linearly with total activity used across a large range. Image uniformity, spatial resolution, and energy resolution degraded linearly with count rate and image distorting effects were observed. Guidelines for CRP testing and a possible method for the correction of count rate losses for clinical images have been proposed.

Health outcomes, quality improvement and cost-effectiveness of the Community Diabetes Education (CoDE) program: Results of a randomized controlled trial

The objectives of this dissertation were to evaluate health outcomes, quality improvement measures, and the long-term cost-effectiveness and impact on diabetes-related microvascular and macrovascular complications of a community health worker-led culturally tailored diabetes education and management intervention provided to uninsured Mexican Americans in an urban faith-based clinic. A prospective, randomized controlled repeated measures design was employed to compare the intervention effects between: (1) an intervention group (n=90) that participated in the Community Diabetes Education (CoDE) program along with usual medical care; and (2) a wait-listed comparison group (n=90) that received only usual medical care. Changes in hemoglobin A1c (HbA1c) and secondary outcomes (lipid status, blood pressure and body mass index) were assessed using linear mixed-models and an intention-to-treat approach. The CoDE group experienced greater reduction in HbA1c (-1.6%, p<.001) than the control group (-.9%, p<.001) over the 12 month study period. After adjusting for group-by-time interaction, antidiabetic medication use at baseline, changes made to the antidiabetic regime over the study period, duration of diabetes and baseline HbA1c, a statistically significant intervention effect on HbA1c (-.7%, p=.02) was observed for CoDE participants. Process and outcome quality measures were evaluated using multiple mixed-effects logistic regression models. Assessment of quality indicators revealed that the CoDE intervention group was significantly more likely to have received a dilated retinal examination than the control group, and 53% achieved a HbA1c below 7% compared with 38% of control group subjects. Long-term cost-effectiveness and impact on diabetes-related health outcomes were estimated through simulation modeling using the rigorously validated Archimedes Model. Over a 20 year time horizon, CoDE participants were forecasted to have less proliferative diabetic retinopathy, fewer foot ulcers, and reduced numbers of foot amputations than control group subjects who received usual medical care. An incremental cost-effectiveness ratio of $355 per quality-adjusted life-year gained was estimated for CoDE intervention participants over the same time period. The results from the three areas of program evaluation: impact on short-term health outcomes, quantification of improvement in quality of diabetes care, and projection of long-term cost-effectiveness and impact on diabetes-related health outcomes provide evidence that a community health worker can be a valuable resource to reduce diabetes disparities for uninsured Mexican Americans. This evidence supports formal integration of community health workers as members of the diabetes care team.^